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Abstract 

For a symmetric bounded measurable function W on [0, 1]^ and a 
simple graph F, the homomorphism density 

t{F,W)= I TT Wixi,xj)dx. 

can be thought of as a "moment" of W. We prove that every such 
function is determined by its moments up to a measure preserving 
transformation of the variables. 

The main motivation for this result comes from the theory of con- 
vergent graph sequences. A sequence of dense graphs is said to 
be convergent if the probability, t{F,Gn), that a random map from 
V{Gn) into V{F) is a homomorphism converges for every simple graph 
F. The limiting density can be expressed as t{F, W) for a symmetric 
bounded measurable function W on [0, 1]^. Our results imply in par- 
ticular that the limit of a convergent graph sequence is unique up to 
measure preserving transformation. 
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Let W be the set of bounded symmetric measurable functions W : [0, 1]" 
M, and let Wq denote the set of functions in W with values in [0,1]. For 
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every W G W and every finite graph F, we define the integral 



t{F,W) = 




Our interest in these integrals stems from graph theory (see next paragraph), 
but such integrals appear in physics, statistics, and other areas. In many re- 
spects, these integrals can be thought of as 2-variable analogues of moments 
of 1- variable functions, so instead of moment sequences, such 2-variable func- 
tions have a "moment graph parameter" (function defined on graphs). Just 
like moments of a 1-variable function determine the function up to measure 
preserving transformations, these "moments" determine the 2-variable func- 
tion up to measure preserving transformations. The exact formulation and 
proof of this fact is the main goal of this paper. 

Our main motivation for this study comes from the theory of convergent 
graph sequences. Let F and G be two simple graphs (graphs without loops 
and multiple edges). Let us map the nodes of F randomly into V{G), and 
let t{F, G) denote the probability that this map preserves adjacency. For 
example, t{K2, G) denotes the edge density of G. In general, we call t(F, G) 
the homomorphism density or simply the density of F in G. 

We call a sequence of simple graphs (G^) convergent, if t(F, G„) has a 
limit for every simple graph F. The notion of convergent graph sequences 
was introduced by Borgs, Chayes, Lovasz, Sos and Vesztergombi p], see also 
[3], and further studied in ^ and 0. Lovasz and Szegedy [TT] proved that 
every convergent graph sequence has a "limit object" in the form of a function 
W G Wo in the sense that 

t(F, Gn) — > t{F, W) as n ^ oo (2) 

for every simple graph F. In this case we say that Gn converges to W. It 
was also shown in [TT] that for every function W G Wq there is a convergent 
sequence (G„) of simple graphs converging to W. To complete the picture, 
the results in this paper imply that the limit object is unique up to measure 
preserving transformations. 
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2 Results 



For the precise statement of our results, we need some definitions. Instead of 
the interval [0,1], we consider two- variable functions on an arbitrary prob- 
ability space; while this does not add real generality it leads to a cleaner 
picture. We need a few definitions. 

We start by recalling some basic notions from probability theory. Let 
{Q,A,n) be a probability space (where fl is the underlying set, ^ is a a- 
algebra on Q, and vr is a probability measure on A). As usual, (fi,^, vr) is 
called complete if A contains all sets of external measure 0, and the comple- 
tion of {fl, A, tt) is obtained by replacing A with the a-algebra generated by 
A and all subsets N G Q of external measure 0. 

Let {Q, A, tt) and {Q', A', vr') be probability spaces, and let be a measure 
preserving map from Q to Q'. The map (p is called an isomorphism if it is a 
bijection between Q and Q' and both and are measure preserving, and 
it is called an isomorphism mod if there are null sets N E A and A^' G A' 
such that the restriction of to 1) \ is an isomorphism between Q \ N 
and Q' \ N' (equipped with the suitable restrictions of (^, vr) and {A',7!''), 
respectively). In the last case {Q,A,tt) and {Q',A',n') are called isomorphic 
mod 0. 

It turns out that several of our results require a little bit more struc- 
ture than that of an arbitrary probability space. In particular, we will con- 
sider Lebesgue spaces, i.e., complete probability spaces that are isomorphic 
mod to the disjoint union of a closed interval (equipped with the standard 
Lebesgue sets and Lebesgue measure) and a countable set of atomsj^ 

2.1 Graphons and Graph Densities 

We are now ready to introduce the main objects studied in this paper. 



^See [13], Section 2.2 for an axiomatic definition of Lebesgue spaces, and Section 2.4 
for the proof that a probabihty space is Lebesgue if and only if it is isomorphic mod to 
the disjoint union of a closed interval and a countable set of atoms. 
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Starting from an arbitrary probability space {Q, A,TT),letW : f2 x f2 — M 
be a bounded, symmetric function measurable with respect to the completion 
of {Q X Q, A X A, n X 7i) . We call the quadruple H = {Q, A, tc, W) a graphon, 
and refer to as a graphon on the probability space {Q, A, it). (As discussed 
above, such functions can be thought of as limits convergent graph sequences, 
which explains the name). 

From our point of view, graphons obtained by changing W on a. set of 
measure 0, or changing the a-algebra A so that W remains measurable, do 
not differ essentially from the original. However, for technical reasons we have 
to distinguish them. We say that a graphon is strong, if W is measurable 
with respect to ^ x ^ (not just the completion of it). We can always change 
W on a set of measure to make the graphon strong (Theorem 13. 2( i)). 

We say that H is complete, if the underlying probability space is complete, 
and we say that it is Lebesguian, if the underlying probability space is a 
Lebesgue space. The completion, H, of H is obtained by completing the 
underlying probability space, i.e., by replacing A by its completion A. 

Let H = {Q, A, 77, W) be a graphon, and let F be a finite graph with 
V{F) = {1, . . . , k}. The definition ([T]) then can be extended as 

t{F,H)= f II W{x„x,)l[d7r{x,). (3) 

i ijeE{F) i=l 

Let H = {n,A,TT,W) and H' = {n',A',n',W') be two graphons. The goal 
of this paper is to determine necessary and sufficient conditions under which 

t{F,H) = t{F,H') (4) 

for all graphs F. 

To this end, we will introduce two different notions of isomorphism. 
Both will be expressed in terms of the following operation: given a graphon 
H' = {Q' , A' , it' , W) and a measure preserving map from a probability 
space {n,A,W) into {n',A',7r'), let (1^')"^ be "pull-back" of W, defined by 
{W')^{x, y) = W{(f){x), (j){y)). If H = (^], A, vr, W) and G = {T, B, p, U) are 
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two graphons and : f2 ^ Gamma is measure preserving from the comple- 
tion A into B such that W = If^ almost everywhere, then we call (p a weak 
isomorphism from H to G. Note that a weak isomorphism is not necessarily 
invertible. 

We say that H and H' are isomorphic mod (in notation H' = H'), if 
there exists a map (p : Q Q' such that (p is an isomorphism mod and 
(W')'^ = W almost everywhere in x fi. For simplicity, we often drop the 
qualifier mod 0. 

We call H and H' weakly isomorphic if there is a third graphon G and 
weak isomorphisms from H and H' into G. It will follow from Theorems 13.21 
and 12.11 that we could require here that G is a strong Lebesguian graphon. 

The isomorphism relation = is clearly an equivalence relation, and it will 
follow from Theorem 12.11 (ii) below that weak isomorphism is an equivalence 
relation as well. Every graphon is weakly isomorphic with its completion, 
and every pair of isomorphic graphons is weakly isomorphic. It is clear that 
if two graphons H and H' are weakly isomorphic then (jlj) holds for every 
graph H. Theorem 12.11 (ii) below will show that the converse also holds. 

To state our results, we need one more notion, the notion of twins. Let 
H = {Q, A,TT,W) be a graphon. Two points xi,X2 G fl are called twins if 
W{xi,y) = W{x2,y) for almost all y E Q. Note that relation of being twins 
is an equivalence relation. We call the graphon H almost twin-free if all there 
exists a set N of measure zero such that no two points in f2 \ iV are twins. 

2.2 Main results 

With these definitions, we can state our main result: 

Theorem 2.1 (i) If H and H' are almost twin- free Lebesguian graphons, 
then dl]) holds for every simple graph F if and only if H = H' . 

(ii) // H and H' are general graphons, then dl]) holds for every simple 
graph F if and only if H and H' are weakly isomorphic. 
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A natural idea of the proof of Theorem 12 .11 is the following: can we bring 
a graphon {Q, A, tt, W) to a "canonical form" , so that isomorphic or weakly 
isomorphic graphons would have identical canonical forms? In the case of 
functions in a single variable, this is possible, through "monotonization" : for 
every bounded real function on [0, 1] there is an unique monotone increasing 
left-continuous function on [0, 1] that has the same moments. 

In Section H] we'll construct not quite a canonical form, but a "canonical 
ensemble" , a probability distribution {Ha) of graphons on the same a-algebra 
such that H = for almost all a, and two graphons are isomorphic if and 
only if their ensembles can be coupled so that corresponding graphons are 
identical (up to sets of measure 0). 

An important element of the proof is a curious measure-theoretic fact. 
Consider a 2-variable function for which all 1-variable functions obtained by 
fixing one of the variables are measurable. This of course does not in general 
imply that the 2-variable function is measurable, but it does imply it in some 
circumstances (see e.g. Corollary 14. 2p . 

As we will see, the second statement of Theorem l2.1l can easily be deduced 
from the first. In fact, we'll show that every graphon is weakly isomorphic 
to a twin-free Lehesguian graphon. (See Theorem 13.21 for more details of this 
isomorphism.) 

We can also transform a Lebesguian graphon into a graphon whose un- 
derlying probability space is the unit interval with the Lebesgue measure, by 
"resolving" the atoms into intervals of the appropriate length. This form is 
the most elementary and therefore useful in applications; however, it is not 
so convenient for the purposes of this paper because we loose twin-freeness. 

It is easy to see that if H and H' are weakly isomorphic, then (jl]) holds not 
only for simple graphs F but also for graphs with multiple edges (which we'll 
call multigraphs if we want to emphasize that multiple edges are allowed; but 
we don't allow loops). Thus (jlj) for simple graphs implies this equation for 
multigraphs. (This fact will be an important step in the proof, see Section 

O) 
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We can formulate our results in a probabilistic way. Recall that a coupling 
between two probability spaces {Q, A, n) and {Q', A', n') is a probability dis- 
tribution on ^ X whose marginals are vr and vr', respectively. A coupling 
between two graphons means a coupling between their underlying proba- 
bility spaces. Let H = {Q, A,tt,W) be a graphon, and let be 
independent random samples from vr. Then we have 

tiF,H) = E{ II WiX,,Xj)). 

Let H = {Q, A, vr, W) and H' = A', vr', W) two graphons, and sup- 
pose that there exists a coupling 7 between them such that W{Xi,Yi) = 
W'{X2,Y2) holds with probability 1 for two independent samples {Xi,X2) 
and (Yi, Y2) from 7. In this case clearly (jlj) holds for every graph F. As we 
will see, Theorem 12.11 implies that in the Lebesguian case the converse also 
holds. 

We sum up the results for the most important special case of functions in 
W, i.e., bounded, symmetric functions W : [0, 1]^ —>■ M which are measurable 
with respect to the Lebesgue sets on [0, 1]^ (the Corollary would remain valid 
for arbitrary Lebesguian graphons, but this would not be essentially more 
general) . 

Corollary 2.2 For two functions W, W G W the following are equivalent. 

(a) For every simple graph F, t{F, W) = t{F, W). 

(b) For every multigraph F , t{F, W) = t{F, W). 

(c) There exists a function U E W and two measure preserving maps 
ip,ip : [0, 1] [0, 1] such that W = t/"^ and W = almost everywhere. 

(d) There exist two measure preserving maps ip,ip : [0,1] — [0,1] such 
that {W')'^ = almost everywhere. 

(e) There exists a probability measure 7 on [0, 1] x [0, 1] such that each 
marginal of 7 is the Lebesgue measure, and if (X, X') and {Y, Y') are two 
independent samples from 7, then W{X,Y) = W'{X' ,Y')) with probability 
1. 



8 



2.3 Examples 

The property of being twin- free is crucial for Theorem 12.11 (i). 

Example 1 Let 0^ : [0,1] [0,1] be the map = kx (mod 1). For 

any function W G W, the functions W^^ and W'^'^ define graphons that are 
weakly isomorphic but in general not isomorphic. Indeed, for a "generic" W 
(say W = xy), every point has two twins in W^^ and three twins in W^^. 
The pair of maps in Corollary 12.21 (c) go from W, while in (d), they go into 

Our next example shows that the Lebesgue property is also needed. 

Example 2 Let be a subset of [0, 1] with inner Lebesgue measure and 
outer Lebesgue measure 1, and let fl' be its complement. Let A and A' 
consist of the traces of Lebesgue measurable sets on Q and Q', respectively. 
Let W and W be the restrictions of the function xy to Q x Q and Q' x fl', 
respectively. The identical embeddings ip : Q ^ [0,1] and ip' : Q' [0, 1] are 
measure preserving, and hence H = {Q, A, tt, W) and H' = {Q', A', n', W) 
are weakly isomorphic. But for every x G fi, we have 



n 

which shows that there is no way to "match up" the points in Q and Q' to 
get an isomorphism mod 0. The same example shows that conclusions (d), 
(e) in Corollary 12.21 could not be extended to the non-Lebesgue case either. 

3 Isomorphism 

The main goal of this section is to describe how a general graphon can be 
transformed into a twin-free Lebesguian graphon. To this end, we have to re- 
call some basic notions from measure theory (mostly because their usage does 
not seem standard), and then discuss different "isomorphism-like" mappings 
between graphons. 
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3.1 Preliminaries 



For a set S of subsets of a set Q, we denote by o"(iS) the o"-algebra generated 
by S. We call a cr-algebra A countably generated if there is countable set 
S C A such that a{S) = A. This is equivalent to the existence of a sequence 
Ai A2 Q ■ ■ ■ of finite cr-algebras whose union generates A. 

We say that a set 5 C ^ is a basis for the probability space {fl,A,TT), 
if a{S) is dense in A, i.e., for every X e A there is a y e a{S) such that 
7r(XAY) = 0. 

Given sets A (Z ft and two points x,y & D,, we say that A separates x and 
y if y} fl A| = 1. We say that a set S of subsets of Q separates x and y 
if there exists a set A e 5 that separates x and y. This leads to a partition 
V[S] of Q by placing two points in the same class if and only if they are not 
separated by S. We say that S is separating if it separates any two points 
in Q. We'll say that a graphon is separating if its underlying cr-algebra is 
separating. 

A probability space {Q!,A!,t^') is called Si, full subspace of (Q,^, tt) if 
is a (not necessarily measurable) subset of fl of external measure 1, A! — 
{A n Q' I A e A}, and t:'{A n VL')) = n{A) for all A e A. 

Consider two probability spaces (Jl, A, tt) and (Q', A' , tt') and a measure 
preserving map : Q — > $7'. The map is called an embedding of the 
first space into the second if is an isomorphism between A., vr) and 
a full subspace of (O',^', tt'). We call an embedding of a graphon if = 
{Vt,A,Ti,W) into a graphon H' = {Vl' , A! .-n' ,W') if is an embedding of 
(fi,^, vr) into {Vt',A!,Tx') and (l^')*^ = W almost everywhere. 

Let A, tt) be a probability space and / : f2 — M, a bounded A- 
measurable function. Let ^0 ^ be a sub- cr-algebra. The conditional 
expectation E(/ | ^0) is the set of all ^Q-nicasurable function /' such that 
J^^f dn = f^^ f dn for all Aq G ^o- It is "well known that such functions 
exist and any two such functions differ only on a set of vr-measure 0. We'll 
write (somewhat sloppily) /' = E(/ | ^0) instead of /' G E(/ | Aq). We say 
that / is almost Ao-measurable, if there is an ^o-measurable function /' such 
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that f = f TT-almost everywhere. Clearly we must have /' G E(/ | Aq), and 
it does not matter which representative of E(/ | Aq) we choose, so (again 
somewhat sloppily) we can say that / is almost ^o-nieasurable if and only if 
/ = E(/ I ^o) almost everywhere. 

3.2 Push-Forward and Quotients 

Let {Q,A,it) and {Q',A',7t') be probability spaces and let : Q ^ Q' he a. 
measure preserving map. We have described how to "pull back" a graphon on 
{Q', A', n') to a (weakly isomorphic) graphon on {Q, A, vr). It is also possible 
to "push-forward" a graphon H = {Q, A, n, W) to a graphon {Q', A', n', W^). 
This is defined by the requirement that 



for all A[,A'2 G A'. The next lemma states that the "push- forward" W^p is 
well defined, and that (li^)'^ is a certain conditional expectation of W. 

Lemma 3.1 Let {Q,A,7c) and {Q'^A'jTt') be probability spaces, let (f) : Q 
Q' be a measure preserving map, and let W be a graphon on {Q,A,'n-). 

(i) There exists a bounded, symmetric function : Q' x Q' ^ M. that is 
A' X A' measurable and satisfies ([6]). It is unique up to changes on a set of 
measure zero in Q' x Q' . 

(ii) LetA^ = 0"^(^'). Then (W^)'^ = E{W \ A^xA^) almost everywhere. 

(iii) If (j) is an embedding of {Q,A,n) into {Q',A',n'), then (VF</,)'^ = W 
almost everywhere. 

Proof. (i) By linearity, it is easy to see that we can restrict ourselves to 
the case where W takes values in [0, 1]. Define a measure yU on x A' by 







0-i(A'i)x0-i(Ai.) 
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for A[, A2 e A. With this definition, we have that 

< i^{A[ X A',) < 7r{r\A[))7r{r'{A',)) = (tt' x 7t'){A[ x A',), 

implying in particular that /i is absolutely continuous with respect to tt' x tt'. 
Hence the Radon-Nikodym derivative, 

is well defined. Using the above bound once more, together with the fact 
that n{Ai X A2) = fJ.{A2 X Ai), we furthermore have that 

0<W^{x,y)<l and W^{x,y) ^ W^{y,x) (7) 

almost everywhere. Changing on a set of measure zero, we may assume 
that these relations hold everywhere. To define for a general bounded 
function W, we use linearity. 

(ii) Let Ai,A2 G A^, i.e., let Ai = and A2 = (1)'^{A'2) for some 

A\, A2 e A'. By the definition of W^, the fact that (j) is measure preserving, 
and the definition of (W^)'^, we have that 

j W(x, y) dnix) dniy) = j W^(x', y') dn'ix') dn'iy') 

A1XA2 A[xA'^ 

W^{(l){x),(l){y))d7r{x) d7r{y) 



A1XA2 

{W^f{x,y) dirix) d7:{y). 
A1XA2 

This imphes that (W^)'^ — E{W \ A4, x A4,) almost everywhere. 

(iii) Since (j) is an isomorphism between [fl, A, tt) and a subspace of 
{fl',A',n'), we know that given any A E A, we can find an A' G A' such 
that (f){A) = A' n (t){n). But then 0"^^') = 0"^(0(v4)) = A, proving that 
A e A^. Thus A^ — A, which implies that (W^)'^ — W almost everywhere. 
□ 
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We can use the "push-forward" construction to define quotients of 
graphons. Let H = {Q, A, vr, W) be a graphon, let V be an arbitrary partition 
of Q into disjoint sets, and for x & Q, let [x] denote the class in V that con- 
tains the point x. We then define a graphon H/V = {^/V, A/V, tt/V, W/V) 
and a measure preserving map (p : Vt ^ Vt/V as follows: the points m VL/V 
are the classes of the partition V, 4> is the map : x t— > [x], A/V is the 
cr-algebra consisting of the sets A' C Q/V such that (j)~^{A') G A, and 
{7c/V){A') := 7i{(j)~^{A')). Then is measure preserving, and the function 
W/V = is defined by ©. 

3.3 Reductions 

Now we are able to state the theorem that allows us to reduce every graphon 
to a twin-free Lebesguian graphon. 

Theorem 3.2 (i) Let H = {Q, A, vr, W) be a graphon. Then one can change 
the value of W on a set of it x ir-measure to get a strong graphon. 

(ii) Let H = {Q, A, it, W) be a graphon. Then there exists a countably 
generated a -algebra Aq C A such that W is {Aq x Aq) -measurable. 

(iii) Let H = {Q, AjTTjW) be a graphon. Then the graphon H/V[A] is 
separating. If H is countably generated, then so is H/V[A]. 

(iv) Let H = {Q, A, it, W) be a separating graphon on a probability space 
with a countable basis. Then the completion of H can be embedded into a 
Lebesguian graphon. 

(v) Let H = {Q, A, 71, W) be a graphon, and let V be the partition into 
the twin-classes of H. Then H/V is almost twin-free. If H is Lebesguian, 
then H/V is Lebesguian as well. Furthermore, the projection H — > H/V is 
a weak isomorphism. 

Corollary 3.3 Every graphon has a weak isomorphism into a strong 
Lebesguian graphon. 
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The proof of this theorem (which is not hard, but technical) will be given 
in the rest of this section. 

3.3.1 Making a graphon strong 

Let H = {n,A,Tr,W) be a graphon, and let W = E{W \ Ax A). Then 
W is ^ X ^-measurable, and changing W' on a set of measure 0, we may 
assume that W is symmetric and bounded. Moreover, XixA'^^' ~ ^) ~ ^ 
for all A, A' e A, which implies that Jg{W' - W) = for all sets S in the 
completion of ^ x so 1^ = W almost everywhere. These observations 
prove part (i) of the Theorem. 

3.3.2 Countable generation 

We prove a simple lemma, which implies Theorem I3.2( ii). and will also be 
used at several other places (Sections 14. II and 15.21) . 

Lemma 3.4 Let {Q,A) and {Q',A') be measurable spaces, and let W : 
Q X Q' ^ be a bounded, {A x A') -measurable function. Then there ex- 
ist countably generated a-algebras Aq C A and A'q C A' such that W is 
{Aq X A'q) -measurable. 

Proof. Let C be the set of bounded, {A x ^')-measurable functions W for 
which the statement of the lemma is true. The set C is clearly a vector space 
that contains the constant function 1 as well as the indicator functions of all 
rectangles A x B with A & A and B E A'. If is further not hard to show 
that if (Wk) is a sequence of non-negative functions in C and Wk t M/^ for a 
bounded function W, then the limiting function is in C as well. By the 
monotone class theorem (see, e.g.. Theorem 3.14 in [14J), we conclude that 
C contains all bounded functions which are measurable with respect to the 
(T-algebra generated by the rectangles A x B, i.e., the cr-algebra A x A'. □ 
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3.3.3 Merging inseparable elements 

If we identify elements in the same class of the partition V[A], we get a 
cr-algebra which is isomorphic under the obvious map. This implies (iii) of 
Theorem O 

3.3.4 Lebesgue property 

Consider a separating graphon H = {Q, A,tt,W), and assume that A is 
generated by the countable set S. Then 5 is a basis for the completion of 
{Q,A,tt). We invoke the fact (see e.g. [13], Section 2.2) that any separat- 
ing complete probability space with a countable basis can be embedded into 
a Lebesgue space. Thus there exists an embedding ip of the completion of 
{Q,A,tt) into a Lebesgue space {Q',C',\'). Let W be the push-forward of 
W, W = W^. By Lemma EH we have that (W)''' = W almost every- 
where, which shows that ip is an embedding of the completion of H into 
{fl', C, A', W). This proves part (iv) of Theorem 13. 2[ 

3.3.5 Partitions into Twin-Classes 

We prove (v) in Theorem l3.2[ We may assume that A is countably generated. 
Indeed, by Lemma [131 we can replace .4 by a countably generated a-algebra 
^0- This does not change the relation of being twins: Two points x,x' & Q 
are twins if and only if the set A^^x' = {y G : W{x,y) = W{x,y')} has 
measure 1. Since W is measurable with respect to AqX Aq, the set A^y lies 
in ^0 C A, implying that x and x' are twins with respect to H if and only 
if they are twins with respect to Hq. 

Let Ap consists of those sets in A that do not separate any pair of twin 
points. Clearly A-p is a a-algebra. 

Claim 1 W is almost A-p x Ap- measurable. 

Let W = E{W I Ap X Ap). We want to prove that 

/ W{x,y)d'K{x)d'n{y) = / W{x,y)dTx{x)dTx{y) (8) 
J AxB Jaxb 
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for all A, B G A. Define the functions 

gA = E(U I Av), UA{y) = / W{x,y)d7i{x), Va{x) = I W{x,y)gAiy)d7r{y). 



Since UA^y) = Ua{z) if y,z are twins, the function Ua is ^-p-measurable, 
similarly for Va, and obviously for gA- Repeatedly using the fact that J fg = 
f fE{g I ^o) if / is .Ao-nieasurable, this implies 

W{x,y)dn{x)dn{y) = / lB{y)UA{y)d'K{y) = / gB{y)UA{y)dn{y) 

AxB J J 



VBix)lAix)dn{x) = J VBix)gAix)dTT{x) 
W{x, y)gA{x)gBiy)dTr{x)dTT{y) 
W{x, y)gAix)gB{y)dn{x)dn{y) 
W{x, y)dn{x)dir{y). 

AxB 

(where the last equality follows since W is A-p x ^p-measurable). This 
implies ([8]) and completes the proof of Claim [TJ 

Let W = E{W I Av x A-p) as before, then H-p = {il, Ap,'7T,W) is a 
graphon, which is clearly weakly isomorphic to {Q,A,tt,W). Let be the 
set of points x E Q for which {y E Q : W{x,y) 7^ W{x,y)} has positive 
measure. Then clearly is a null set, and two points x,x' E Q\N are twins 
in H if and only if they are twins in Hp. The graphon H/V is obtained 
from Hp by identifying indistinguishable elements, which implies that H/V 
is twin- free. 

To prove that H/V is Lebesguian if H is Lebesguian, we invoke the fact 
(established in Section 3.2 of [13]) that {Vt/V, A/V, vr/P) is a Lebesgue space 
provided (f2, A^ vr) is a Lebesgue space and there exists a countable set 5 C ^ 
that separates two points if and only they are in different partition classes. 

To construct such a set iS, let T be a countable set generating A, closed 
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under finite intersections. For A E A and x E Q, let 

fi,{A) = / W{x,y)dn{y). 

J A 

Since is a bounded A x ^-measurable function, the function A \—>- fix{A) 
is a finite measure for all x E Q, while the function x ^ ^J'x{A) is a A- 
measurable function on Q for all A E A. 

By definition, x,x' E Q are twins iff the set {y E Q : W{x, y) = W{x, y')} 
has measure zero. This is equivalent to the condition that Hx{A) = fix'{A) 
for all A E A. Since the measure /ix(-) on A is uniquely determined by the 
sets in T, we have that x and x' are twins if and only if [ixiT) = fj,x'iT) for 
all T eT. 

For every T E T and rational number r, consider the sets St^t = {x E 
VL : fJ'x{T) > r}. There is a countable number of these. Furthermore, if 
X and x' are twins, then they belong to exactly the same sets Sxy, if they 
are not twins, then there is a T G T such that /ix(T) 7^ yU^/(T), and for any 
rational number between ^x(T) and fix'{T), the set ST,r separates x and x'. 

This completes the proof of Theorem 13. 2[ 

3.4 Isomorphism and Weak Isomorphism 

We conclude this section with relating isomorphism and weak isomorphism. 

Lemma 3.5 Let Hi = {Qi, Ai, iTi, W,i) he graphons with the Lebesgue property 
(i = 1,2), and let cj) : Vti ^ Vt2 he measure-preserving. If Hi is almost twin- 
free, and Wi = W2 almost everywhere, then is an isomorphism mod 0, so 
in particular Hi = H2- 

Proof. Let 

Vt'i = {x eVLi: 1^2(0(2;), 0(2/)) = Wi{x,y) for almost all y}, 

and let Ni = VLi \ VL'^. Then 7ri(A^i) = by Fubini and our assumption that 
Wi = W2 almost everywhere. 



17 



Let N[ be a nullset such that all twin-classes of Hi have at most one 
point in Qi\ N[, and let (p' to be the restriction of (p to Q[ \ N[. Then 
0' is injective: indeed, if xi,X2 G Q'l \ N[ and 0(xi) = (p{x2), then 



Wi{xi,y) = W2{(p{xi),^{y)) = W2{(p{x2) , (piv)) = Wi{x2,y) for almost all 



y by the definition of Q[, hence Xi and X2 are twins, a contradiction. As 
shown in [13], Section 2.5, an injective measure preserving map between 
Lebesgue spaces has a measurable inverse defined almost everywhere. This 
implies that 0' : Q[ \ N[ ^ Q2 is an isomorphism mod 0, which shows that 



Corollary 3.6 // two twin-free graphons with the Lebesgue property are 
weakly isomorphic, then they are isomorphic. 

4 Canonical Ensembles 

We could try to construct a "canonical form" of a graphon by assigning "tags" 
to the points in Q. For example, we could tag a point x with its marginal 
d{x) = J W{x,y) d7i{y), or by the sequence of marginals of higher powers of 
W. This, however, would not work: for example, there could be a transitive 
group of measure-preserving permutations of Q leaving W invariant, and 
then all points would still have the same tag. 

To break the symmetry, we select an infinite sequence a = (oi, 02, . . . ) of 
points in Q, which we call anchor points. Now we can tag each point x E fl 
with the sequence 



(where we assume that <W < 1) The map x ^— $a(^) defines a measurable 
map from fl into [0, 1]^ (with respect to the standard Borel a-algebra C on 
[0, 1]^), which in turn defines a measure on the sets S" G £ by 



is an isomorphism mod as well. 



□ 



$«(x) = {W{x, ai), W{x, aa), . . . ) G [0, 1] 



(9) 



A.(^) 



(10) 
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and a graphon W^^ on ([0, 1]^, £, A^) by We denote the completion of 

We will show that if ai, a2, ■ ■ ■ are taken i.i.d. at random with distribution 
TT then with probability one, then is isomorphic mod to the original 
graphon H (see Section 14.21 for details). So using an infinite sequence of 
independent random points as anchor points, the tags of the points contain 
all information about the points. 

These tags are almost canonical, except for the choice of the sequence a. 
So instead of a canonical form, we get a "canonical ensemble" , a probability 
distribution (Ha) of graphons such that H = for almost all a, and two 
graphons are isomorphic if and only if their ensembles can be coupled so that 
corresponding graphons are isomorphic. 

To prove Theorem 12.11 (i), we will therefore have to show that if H and 
H' satisfy (jlj), then we can "couple" the choice of anchor points a in H and 
j3 in H' so that Ha = H'^, thus yielding an isomorphism of H and H'. This 
second step in the proof will be carried out in Section 15.31 

4.1 Measure theoretic preparation 

The next technical lemma will be important in the construction of "canonical 
ensembles" . 

Lemma 4.1 Let (fi, vr) and {Q',A',7t') be probability spaces, and let W : 
Q X Q' —>■ be a bounded A x A' -measurable function. Let Yi, I2, • • • be 
independent random points from Q' . Let Aq A be the (random) a-algebra 
generated by the functions W{-,YiS). Then with probability 1, W is almost 
Ao X A' -measurable. 

Proof. By Lemma 13.41 we may assume that A and A' are countably 
generated. Let A'l C A2 C . . . and A'l C A2 C . . . be a sequence of finite 
cr-algebras with cr(U„v4„) = A and cr(U„v4'„) = A', and let P'^ denote the 
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partition of Q' into the atoms of A'^^. For y E S E P^^ with 7r'(S') > 0, define 

Un,Ux,y) = — ^ V] W{x,Yj) 



We define Un,Ux, y) = H y e S e with 7r'(^) = 0. 

First we prove that for every n > 1, every A ^ A and A' G A'^^, we have 
with probabihty 1 

J Un,mdndn' — > J W dn dir' (m ^ oo). (11) 

AxA' AxA' 

It suffices to prove this in the case when A' = S" G and vr'(S') > 0. Then 
for every yo & A', we have 

Un,m{x,yo) diT^x) = 77a / W {x , Yj) diT (x) . 



hence by the Law of Large Numbers 



Un,m.{x,y^dT[{x) — ^ ^TTT / W dT[ di^ (m^oo). 

7r(^) J 

A AxS 

Since both sides are independent of yo G S, integrating over yo & S equation 
follows. 

The number of choices of n, A G U^Ak and A' G A'^ is countable, and 
hence it follows that with probability 1, ffTTj) holds for all > 1, every 
A G UkAk and A' G Since UkAk is dense in this implies that ffTTl) 
holds for all n > 1, every A G ^ and A' G 

From now on, we suppose that the choice of the Yi is such that this holds. 

For a fixed n, the indices m have a subsequence mi < m2 < . . . such that 
Un,mj converges to some function in the weak-*-topology of L^oiAo x A'^)- 
Hence by (fTTl). 

?7„ (ivr (ivr' = lim / f/„ „ , dn dn' = W dn dn' 

3-*'^ J ' ' J 

AxA' AxA' AxA' 
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for all n > 1, every A & A and A' G A'^. Thus f/„ is a representative of 
E{W I A X Since [/„ is x measurable, it is also a representative 
of E{W I ^0 X ^n)- This shows that for every n > 1 we have 

E{W\Ax A'J = EiW I Ao x A'J (12) 

almost everywhere. 

By Levy's Upward Theorem, the left hand side of f|T2l) tends to E{W \ 
A X A') = W almost everywhere. The right hand side of (fT2|) tends to E{W \ 
Aq X A') almost everywhere, so 1^ = E(Vr | Aq x A') almost everywhere, 
which proves the Lemma. □ 

We formulate a couple of corollaries, the first of which is immediate: 

Corollary 4.2 Let {Q,A,7c) and {Q',A',7i') be probability spaces, let 
W : Q X Q' ^ W be a bounded function that is measurable with respect 
to A X A', and let Aq <Z A be a sub-a- algebra. IfW{-,y) is Ao-measurable 
for almost all x E Q, then W is almost Aq x A' -measurable. 

Corollary 4.3 Let {Q, A,7t,W) be a graphon, and let Xi,X2,... be inde- 
pendent random points from Q. Let Aq ^ A be the (random) a -algebra 
generated by the functions W{-.,Xk). Then with probability 1, W is almost 
Aq X Ao-measurable. 

Proof. Let Ai denote the a-algebras generated by the functions W{-, X2k)- 
Clearly Ai C Aq. By Lemma 14. H W is almost x ^ measurable with 
probability 1, so we can change it on a set of measure to get an x ^ 
measurable function W. Let A'2 be the cr-algebras generated by the functions 
W'{X2k+i, ■)■ Applying the lemma again, we get that W is almost Ai x 
A2 measurable. With probability 1, each function W{X2k+i, ■) differs from 
W'{X2k+i, ■) on a. set of measure only (since the X2k+i are independent of 
^1), and so A2 ^ (r{Ao). So W is ^0 x o"(-^o) measurable, which implies 
that W, and hence W, are almost ^0 x ^0 measurable. □ 
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4.2 Anchor Sequences 

Let us consider the cr-algebra L on [0, 1]^ generated by the sets Ai x x . . . , 
where each Ai is a Borel subset of [0, 1] and only a finite number of factors 
Ai are different from [0,1]. Fix a graphon H = {Q, A,tt,W) with < 
W < 1. For every a G the map : 1] ^ [0, if defined by ^ is 
measurable, and (fTOj) defines a probability measure on £ with respect to 
which $Q is measure preserving. Thus leads to a symmetric, C x C- 
measurable function Wi^,^ : [0, 1]^ x [0, 1]^ — > [0, 1] which we denote by Wa- 
We say that a G is regular if ly = W^" almost everywhere. 

Lemma 4.4 Almost all a G are regular. 

Proof. Let Aa denote the a-algebra of subsets of Q of the form $~^(y4), 
where A E C Note that Aa Ahj the fact that $0 is measurable. Further, 
almost by definition, Aa is the smallest sub- cr-algebra of A such that all the 
functions W{-,ai) are measurable. As a consequence, we may apply Lemma 
14.31 to conclude that for almost all a, W is almost Aa x -measurable, 
which by Lemma [3.11 gives that W = W^°' almost everywhere. □ 

Let Ca be the completion of C with respect to Aq,. Then ([0, 1]^, A^) 
is a complete, Polish space and hence Lebesgue, so Ha = ([0, 1]^, £„, Aq, Wa) 
defines a Lebesguian graphon. 

Lemma 4.5 Let H be a twin free graphon with the Lebesgue property. If a 
is regular, then is an isomorphism mod and Ha = H. 

Proof. By ffTOl) . $q is a measure preserving map from {Q,A,tc) into 
([0, 1]^, £, Aa). Since {Q,A,7t) is complete, is measurable (and measure 
preserving) from {Q,A,7!') into ([0, 1]^, £„, A^) as well. By the definition of 
a regular a, H^" = H almost everywhere, and by Lemma 13.51 $q, is an 
isomorphism mod 0. □ 
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5 Coupling 



5.1 Partially Labeled Graphs and Marginals 

We recall some notions from [8]. A partially labeled graph is a finite graph 
in which some of the nodes are labeled by different nonnegative integers. 
Two partially labeled graphs are isomorphic, if there is a label-preserving 
isomorphism between them. A k-labeled graph is a partially labeled graph 
with labels 1, . . . ,k. 

Let Fi and F2 be two partially labeled graphs. Their product F1F2 is 
defined as follows: we take their disjoint union, and then identify nodes with 
the same label (retaining the labels, and any multiple edges which this might 
create). For two unlabeled graphs, F1F2 is their disjoint union. Clearly this 
multiplication is associative and commutative. 

Let H = {Q, A, 71, W) be a graphon, and let a = (oq, ai, . . . ) be an infinite 
sequence of points in Q. Let F be a partially labeled graph with nodes 
V{F) = {1, . . . ,k}, where nodes 1, . . . , r are labeled by distinct nonnegative 
integers ii, . . . , ir- Let Xj = ai^ for 1 < i < r, and let X^+i, . . . , G f2 be 
independent points from the distribution vr. Define 



Of course, this value only depends on those elements of a whose subscripts 
occur as labels, and we'll sometimes omit the tail of a if it contains no labels. 
For example, if F is a 2-labeled triangle, then 



t^{F,H) = E(^ n ^i^J^^j)) 



ij&E{F) 



ta,a,{F,H)=t^{F,W) = E{W{a^,a2)W{a2,X)W{a^,X)) 




It is easy to see that if Fi and F2 are two /c-labeled graphs, then 
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5.2 Multiple Edges 

Lemma 5.1 Let H = {Q,A,n,W) and H' = {Q',A',7i',W') be two 
graphons, and assume that t{F, H) = t{F, H') for every simple graph F . 
Then t{F, H) = t{F, H') for every multigraph F . 

Proof. We use induction on the number of parallel edges in F. Suppose 
that F has two nodes, say i and j, connected by more than one edge. Let Fk 
denote the multigraph obtained from F by subdividing one of these edges by 
k — 1 new nodes. Let F' denote the multigraph obtained by removing one 
copy of the edge ij. So Fi = F, but for A; > 1, has fewer parallel edges 
than F, and so we may assume that 



holds for every k >2. We consider all the multigraphs Fk and F' as 2- labeled 
graphs, with i and j labeled 1 and 2. 

Since Fk can be thought of as the product of F' and a path Pk+i with 
k + 1 nodes (the endpoints labeled), we can write 



which we can recognize as k-th power of the kernel W as an integral operator. 

At this point, it will be useful to assume that H and H' are countably gen- 
erated graphons (this can be done without loss of generality by Lemma [3. 4p . 
As a consequence, W is an integral operator on the separable Hilbert space 



t{Fk,H)=t{Fk,H') 




and 




The first factor inside the integral can be expressed as 




W{x, xi) ■ ■ ■ W{xk-iy) d7i{xi) . . . dTr{xk-i), 
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A, vr), and since W is bounded, this implies that W is Hilbert-Schmidt 
and thus compact, which in turn imphes that W has a spectral representa- 
tion: 

oo 

n '^n{x)Lpn{y). (13) 

n=0 

It follows that for every k > 2, 

oo 
n=0 

and hence 

oo „ 

Similarly, let 



n=0 



1=0 

be the spectral representation of W ^ then we get that for every k >2, 

oo 

= t{Fk, H) - t{Fk, H') = anX'n ' buf^l (14) 



n=0 



where 



and 



an= (pnix)(pniy%yiF',U)d7r{x)dTT{y) 



fcn = y 1pn{x)^Pn{y)txy{F',W)dTT{x)d7T{y) 

are independent of k. (The integrals exist since tx,y{F',H) is a bounded 
function of x and y.) It follows that in (1141) everything must cancel, in other 
words, for every value c. 



^{a„ : Xn = c} = ^{bn : /in = c} 
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(it is known that the sums on both sides have a finite number of terms, since 
the multiphcities of the eigenvalues are finite). 

Now while (fT3l) may not be true with equality, the "trace" with any other 
kernel gives an equation; in particular, 

oo „ oo 

t{F, H) = J2^n W{x, y%y{F', H) d7i{x) d7r{y) = ^ a„A„, 

n=0 ^2 n=0 

and similarly 

oo 

t{F,H') = J^bnl^n, 
n=0 

which shows that t{F, H) = t{F, H') as claimed. □ 

It will be convenient to assume that < W,W' < 1. If this does not 
hold, we can apply a linear transformation to the values of the functions, to 
get two functions Wq and Wq with < Wq, Wq < 1. Expanding the product 
in the definition ([3]), t{F, Wo) can be written as a linear combination of the 
values t{F', W), where F' is a subgraph of F. Thus t{F, W) = t{F, W) for 
every graph F if and only if t{F, Wq) = t{F, Wq) for every graph F (where 
"graph" could mean either simple graph or multigraph) . So (jl]) holds for Wo 
and Wq if and only if it holds for W and W'. If we prove that this implies 
(fi. A, IT, Wo) = (fi'. A', vr', W^), then H = H' follows trivially. 

5.3 Coupling Anchor Sequences 

Consider two graphons H = {Q,A,7!-,W) and H' = {Q' , A' ,tc' ,W') satis- 
fying the conditions in Theorem 12.11 (i) and < W, W' < 1 . Given two 
"anchor" sequences a = (ai,a2,...) from Q and /5 = (61,625 •••) from Q', 
let = ([0, 1]^, X^, W^) and H'^^ = ([0, 1]^, C'^^, X'^, W'p). We would like 
to select a and [3 in such a way that = X'p and Wa = W'p almost every- 
where. This will complete the proof of the theorem. By Lemma 14. 4^ we can 
guarantee that both a and /3 are regular by selecting 01,02, ... as well as 
61, 62 • • • independently and uniformly from vr and vr', respectively; however, 
the equality of W^ and WL will only be true if we couple a and (3 carefully. 
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The condition on the couphng is described in the following lemma. 



Lemma 5.2 Let H = {n,A,7i,W) and H' = {n',A',7i',W') be two 
graphons, and let a = (ai, 02, . . . ) and P = {bi,b2, . . .) be regular sequences 
for H and H' , respectively. Suppose that for every partially labeled multigraph 
F, 

t^{F,H)=tp{F,H'). 
Then Aq = A^Jj and Wa = Wp almost everywhere (with respect to Aq = X'^). 

Proof. First, we show that A^ = A|^. These probability measures are 
defined on the a-algebra C as the distribution measures of the random vari- 
ables W{X, ai), W{X, as), . . . ) and W'{Y, bi), W'{Y, 62), ■■■), where X and 
Y are random points from vr and vr', respectively. By Lemma [6. II it therefore 
suffices to prove that these random variables have the same mixed moments. 

Let {ki, ^2, ■ ■ ■ ) be a sequence of nonnegative integers, of which only a 
finite number is nonzero; say ki = for i > m. Then 

£{\[W{X,a,f^)=t^{F,H), 

i 

where F is the star on m + 1 nodes, with the endnodes labeled 1, . . . ,m, 
and the edge between the center and endnode i replaced by ki parallel edges. 
Similarly, 

^{X\W'{YXf^)=t^{F,E'). 

i 

These numbers are equal by the hypothesis of the Lemma. This proves that 

Second, we show that Wa{x,y) = Wl^{x,y) for almost all x,y E [0,1]^. 
It suffices to show that the random variables Zi = {X,Y,Wa{X,Y)) and 
Z2 = (X,y,PF^(X,F)) (with values from [0,1]^ x [0,1]^ x [0,1]) have the 
same distribution, where X and Y are independent points in {Q^, A^). 

We can generate Zi by choosing independent uniform random points X' 
and Y' from Q, and letting X = and Y = ^p{Y'). Since a is regular. 
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we have that 

W^{X,Y) = W{X\ Y') 
with probabihty one, and hence 

Zi = {W{X\ ai), W{X\ as), ... , W{Y', ai), W{Y\ aa), . . . , W{X\ Y')). 

Similarly, we have 

= {W\X\ h), W'{X", 62), ... , W'{Y", h), W'{Y", 62), ... , W'{X", Y")), 

where X" and Y" are independent random points from tt'. To prove that Zi 
and Z2 have the same distribution, it again suffices to prove that they have 
the same mixed moments. 

A particular mixed moment is given by nonnegative integers {ki, k2, . . .), 
{Ii,l2, ■ ■ ■) and m (of which only a finite number is nonzero; say ki = k = 
for i > n). Let us define the multigraph F as follows. F has two unlabeled 
nodes and Vy, and n further nodes labeled 1, . . . , n. We connect to i by 
ki edges, Vy to i by U edges {i = 1, . . . ,n), and to Vy by m edges. Then 

E{W{X', ai)''' ■ ■ ■ W{X', an)''"W{Y', ai)''' ■ ■ ■ W{Y', an)''"W{X', Y')) = t^{F, H). 

and similarly 

E{W\X", bif' ■ ■ ■ W'{X", hnf-W'iY", hif^ ■ ■ ■ W'{Y\ hnf-W'{X, Y)) = tp{F, H') 

These two numbers are the same by hypothesis. This completes the proof of 
the Lemma. □ 



To prove Theorem 12. ![ we next show: 

Lemma 5.3 Let H = {n,A,n,W) and H' = {n',A',n',W') be two 
Lehesguian graphons such that 

t{F,H)=t{F,H'). 
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for every multigraph F. Then we can couple sequences a G f2 with sequences 
13 e Vt"' so that if a, (3) is a sequence from this joint distribution, then 

t^{F,H) = tp{F,H'). 

holds almost surely for every partially labeled multigraph F. 

Proof. Let J-'k be the set of fc-labeled multigraphs. We define recur- 
sively a coupling of sequences a G fi'^ with sequences (3 G fi'^ so that 
ta'{F, H) = tj3/{F, H') holds almost surely for every F G J-'k- Let (ai, . . . , a^) 
and . . . , be chosen from this coupled distribution. Consider two ran- 
dom points X from vr and Y from vr', and the random variables 

A = {ta-i^,„a^x {F,H): FeJ^k+i) 

and 

B = (tb-^,,,b,^Y{F, H) : F G Tk+i) 

with values in [0, IJ'^'-'+i. We claim that the variables A and B have the 
same distribution. It suffices to show that A and B have the same mixed 
moments. Consider any moment of A; in other words, let Fi, . . . , F^ G J-'k+i, 
let qi,...,qm be nonnegative integers, and let F^' be obtained from Fj by 
replacing each edge in Fi by qi edges. Then the corresponding moment of A 
is 

m 

E(J[t,,,„,^x{F.,Hr) = E{t,,,„,^x{Fr...Fr,H))=t,„„,^{F,H), 
1=1 

where the multigraph F is obtained by unlabeling the node labeled + 1 in 
the multigraph F^^ . . . F^ . Expressing the moments of i? in a similar way, 
we see that they are equal by the induction hypothesis. This proves that A 
and B have the same distribution. 

Using Lemma 16.21 it follows that we can couple the variables X and Y so 
that A = B with probability 1. In other words, we can replace X and Y by 
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a random variable (X', Y') G f2 x f2' so that X' has distribution vr, Y' has 
distribution vr', and their joint distribution satisfies 

for every F G Tk+i with probabihty 1. Thus we have extended the couphng 
to 9!" X 

It is clear that this sequence of couplings defines a coupling of fi^ with 
Vt'^ as claimed. □ 

5.4 Conclusion of proofs 

Proof of Theorem 12.11 Part (i) follows easily: if we choose random se- 
quences (a, (3) from the coupled distribution given by Lemma [S75| then these 
sequences will be regular with probability 1, and so they satisfy the conditions 
of Lemma 15. 2[ 

To prove (ii), suppose that H = {n,A,Tr,W) and H' = {n',A',Tr\W') 
satisfy (jl]) for every simple graph F. By Corollary 13. 3[ we can find twin- 
free Lebesguian graphons G = (T, B, p, U) and G' = (T', B', p', U') and weak 
isomorphisms and 0' from H and H' to G and G", respectively. It follows 
by Theorem 12. l( i) that the G and G' are isomorphic mod 0, so in particular 
U = iU')^' almost everywhere for some measure preserving map ■?/'': F —> F'. 
Defining if) : ^ V hy ipi^x) = ip' {(j){x)) , we conclude that W = {U')^ almost 
everywhere. The maps and 0' are measure preserving from the completions 
H and W into G'. □ 

Proof of Corollary 12.21 The equivalence of (a), (b) and (c) follows by 
Theorem l2.1l (ii) and the fact that a function which is measurable with respect 
to the completion of £ x £ is almost everywhere equal to a function which 
is measurable with respect to C x C. In the proof of (c), Theorem 12.11 may 
give a graphon containing atoms, but it is easy to replace these atoms by 
intervals of appropriate length. 

To prove that (c)^^(e), assume that (p,ip and U exist as in (c). Let 
X, X' G [0, 1] be independent random points from the uniform distribution 
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A on [0, 1]. Since and ip are measure preserving, ip{X) and ip{Y) have the 
same distribution, and hence by Lemma 16.21 there is a couphng measure 7 
on [0, 1] X [0, 1] with marginals A such that if {X, X') is a random sample 
from 7, then if{X) = ipiX') with probability 1. So if {X,X') and {Y,Y') are 
independent random points from 7, then 

W{X,Y) = U{phi{X),pht{Y)) = U'{psi{X'),psi{Y')) = W'{X'X). 

To prove that (e)^>(d), consider the projections $, \1' : [0,1]^ [0,1] 
defined by $(a;, x') = x and \E'( Then 

W''{{X,X'),{YX)) = W{X,Y) 

and 

{wr{{x,x'),{YX)) = w'{x'X) 

Thus, VT* = {W')^ almost everywhere. Furthermore, $ and \E' are measure 
preserving if we consider the coupling measure 7 on [0, 1]. 

Since the completion of ([0, 1]^,£2,7) is a Lebesgue space, we can find a 
measure preserving map p : ([0, 1], A) — > ([0, 1]^,7). Setting = $ o p and 
'?/' = \E'op, we obtain the desired measure preserving maps ip : [0, 1] [0, 1] 
such that = [W')^ almost everywhere. 

Finally, (d)^(a) is trivial. □ 
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6 Appendix: Moments and coupling of prob- 
ability distributions 

In this section we prove some probability theory lemmas, that are "well 
known" but not easy to reference. We start with the fact that if two vector 
valued random variables have the same mixed moments, then they have the 
same distribution (cf Feller [7], Problem XV. 9. 21.). 

Lemma 6.1 Let {Q,A,tt) and {Q',A',7[') be probability spaces, and let 
f : Q ^ [0, 1]^ and g : Q' ^ [0, 1]^ be measurable functions, with 
fi^) = {fi{x)j2{x),. . .) andg{y) = {gi{y), g2{y), . . .). If 

J f,{xf^...fn{xf"d7i{x) = j g,iy)'\..gM'"dn'iy) 

for every finite sequence of nonnegative integers ki, . . . , kn, then Ti{f^^{B)) = 
n'{g-\B)) for every Borel set B C [0, 1]^. 
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Proof. It suffices to prove tfiat 7r{f~^{B)) — 7r'{g~^{B)) for every Borel set 
of tfie form S = 7i x 72 x ■ ■ ■ -^n x [0, 1] x . . . , where /i, . . . , /„ are intervals. 
Let pj^rnix) be a polynomial that approximates the indicator function Ij. on 
[0, 1] in Li with error less than 1/m (j = 1, . . . , n). Then 



/ 



Pl,m{fl{x))---Pn,m{fn{x))dx > J 1/^ (/i (x)) • • • 

n a 

= J ldx^Tr{f-\B)) (m^oo). 
f-HB) 

Similarly, 

J Pi,m{gi{x)) ■ ■ ■Pn,m{9n{x)) dx — > n{g'^{B)) (m oo). 
a 

But the left hand sides of these two relations are equal for all m, which proves 
the Lemma. □ 

We need the following natural fact about coupling. 

Lemma 6.2 Assume that (Jl, A, tt) and (Jl', A, tt') are Lebesgue spaces, and 
{r,B,p), a countably generated separating space. Let f : — > F and 
g : — > r &e measure preserving maps. Then there exists a coupling u 
of (Q, A, tt) and (Jl', A, tt') such that 

T^{{x,y) : f{x) = g{y)] = 1. 

Proof. For A E A, consider the measure A'^(i?) = 7i(A fl f~^{B)) defined 
for B E B, and its Radon-Nikodym derivative = dX'^/dp. Since 
7i{f^^{B)) = p{B), this derivative exists, and < < 1 almost everywhere. 
Furthermore, /® = and f^ = l almost everywhere. 

Similarly for C G A', define p^{B) = 7r'{C n g-^B)) and g^ = dp^/dp. 
Finally, let 

v{AxC)= [ f^g'^dp. (15) 
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Clearly 

and similarly ^{A x C) < n'{C). Hence in particular u^A x C) = if either 
n{A) = or n'{C) = 0. 

Claim 2 If Ai e A, Ci E A' (i & I) and the sets Ai x Cj form a (finite or 
countably infinite) partition of A x C (A & A, C & A'), then x C*?) — 

v{A X C). 

It is easy to sec that if Ai, A2 E A arc disjoint sets and A = AiU A2, then 
/"^i + f^'^ = f^ almost everywhere. It follows that for every C G A! , we have 
v{Ai X C) + v{A2 X C) = v{A X C). This implies by standard arguments 
that the claim holds if |/| is finite. This in turn implies that v extends to a 
finitely additive measure on the algebra JF of sets that can be written as the 
union of a finite number of product sets Ax C (A G C G A). 

In the case of infinite |/|, it follows that A x Q) < ^{A x C); in 
fact, for every finite JCI^we have UjgjAj x Ci C A x C, and hence by the 
finite additivity oi u, we have 

X Ci) = iy(Lii^jAi X < v{A X C). 

ieJ 

Since this holds for every finite subset J of /, it also holds for /. 

Suppose that there is a partition where {Ai x Ci : i — leN}oiAxC 
and an £ > for which 

J2 ^{M X Ci) < v{A X C) - 4£ 

i 

on a set B of positive measure. Now we use that (^2, A^ n) and {Q', A, vr') are 
Lebesgue spaces, so we may assume that they are intervals [0, a] and [0, b] 
respectively, together with a countable set of atoms. Thinking of the atoms as 
converging to a from above, we have a compact topology on them. For every 
i, we can find an open sets Ui ^ Ai and Vi ^ Cj such that 7T{Ui) < TT{Ai)+e2~^ 
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and TT'{Vi) < vr'(Ci) + e/2\ Also, we can find closed sets U C A and V CC 
such that 7r(f/) > n{A) - e and 7r'(F) > n'{C) - e. Then 

y{U, X V,) < u{A, X Ci) + z/((f/, \ A,) X Ci) + z/(f/, X {V, \ C,)) 

< z/(Ai X Ci) + 7r(t/i \ Ai) + 7r'(\/i \ C^) < z/(A, x C^) + 2e2-\ 

It follows similarly that 

v{U X > X C) - 2e. 

Hence 

v{Ui xVi)<Y^ ^^^i ^ +2e< v{A xC)-2e< v{U x V). 

i i 

The open sets Ui x Vi cover the compact set U xV , and so a finite number 
of them also covers. But the contradicts the finite additivity of v which we 
already established. 

Claim 3 The setfunction v extends to a measure on A x A' . 

We have seen already that u extends to JF; it follows by Claim [2] that this 
extension is cr-additive. Thus the Claim follows by the Measure Extension 
Theorem. 

Define A = {{x,y) ^ Q x Q' : f[x) = g{y)}- To complete the proof of 
the Lemma, we want to prove that z/ is a coupling between {Q, A, vr) and 
{n',A,n') (which is trivial), and that u{n x \ A) = 0. Let 5 C i3 be a 
countable family separating the elements of F. Then 

nxn'\A=\J f-\S) X g-\T \S)u[j r\T \ S) X g'\S). 
ses ses 

Consider any term here, say f~^{S) x g^^{T \ S) = A x C . Then 

uiAxC)= [ f^g'^dp= [ + [ . 

J Js Jr\s 
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Here 



/ /V^P< / 9'''dp = i,^\S) = 7:'{g-'{T\S)ng-\S)) = 0, 
Js Js 

and similarly 



dp = 0. 

This proves that x \ A) = 0. □ 
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